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Abstract 

We show that the limiting state vector in the differential model of consensus seeking with an arbitrary 
communication digraph is obtained by multiplying the eigenprojection of the Laplacian matrix of the 
model by the vector of initial states. Furthermore, the eigenprojection coincides with the stochastic 
matrix of maximum out-forests of the weighted communication digraph. These statements make the 
forest consensus theorem. A similar result for DeGroot's iterative pooling model requires the Cesaro 
(time-average) limit in the general case. The forest consensus theorem is useful for the analysis of 
consensus protocols. 



in 



Index Terms 

' Consensus, Eigenprojection, Matrix exponent, DeGroot's iterative pooling. 



g ; I. Introduction 



The continuous-time model of consensus seeking in a multiagent system has the form [|22|. 



> 

00 

oo 



±i{t) = Ui(t), (1) 



Ui{t) = -^a-ij (xi(t) - Xj(t)) , i = l,...,n, (2) 

j=i 
O ■ 

where Xi(t) is the state of the z'th agent and > is the weight with which agent i takes into 
account the discrepancy with agent j. The matrix form of the model ©-© is: 

x(t) = -Lx(t), (3) 

where x(t) = (xi(t), . . . ,x n (t)) T , L is the Laplacian matrix of the model ©-©: 

L = diag(Al) — A, (4) 

A = (cLij) nXn7 and 1 = (1, ... , 1) T 

The nonsymmetric Laplacian matrices of this kind were studied in fl}, flU, ED- 

In this paper, we present the forest consensus theorem stating that for an arbitrary non-negative 

matrix A and any trajectory x(t) satisfying ©-©, 

lim x(t) = J x(0) 

t—>oo 
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holds, where J is the eigenprojection of L, which coincides with the matrix J of maximum 
out-forests of the communication digraph corresponding to A. 

A similar result, which involves the Cesaro limit, holds for the discretization of the model 
©-©. 

The paper is organized as follows. After introducing the necessary notation and summarizing 
the preliminary results, in Section [Til] we prove the forest consensus theorem. Section [IV] is 
devoted to the properties of the limiting state of the model. Section [V] contains a numerical 
example; in Section [VH we show that the classical results on a communication digraph having 
a spanning diverging tree immediately follow from the forest consensus theorem. Finally, 
Section Ivm presents a counterpart of the forest consensus theorem for the discretization of 
the model ©-©. 

II. Basic concepts and preliminary results 
A. Eigenprojections and functions of matrices 

Let A G C nxn be an arbitrary square matrix. Let v = hid A be the index of A, i.e., the 
smallest k e {0, 1, . . .} such that rankA fc+1 = rankv4 fc , where A is identified with the identity 
matrix I. A is nonsingular iff v = 0. The index of a singular matrix is the index of its eigenvalue 
0, i.e., the multiplicity of as the root of its minimal polynomial, or, equivalently, the size of 
the largest Jordan block with zero diagonal in its Jordan form. If v = 1 then the algebraic and 
geometric multiplicities of coincide (in this case, the eigenvalue of A is called semisimple). 

Let 71(A) and J\f(A) be the range and the null space of A, respectively. The eigenprojection 
E4l of A at eigenvalue is3 a projection (i.e. an idempotent matrix) Z such that 1Z(Z) = J\f(A u ) 
and J\f(Z) = 7l{A u ). In other words, Z is a projection to J\f(A u ) along TZ(A U ). In the 
case of a singular matrix A, following [|25l . we call Z the eigenprojection of A (without 
mentioning eigenvalue 0). The eigenprojection is unique because an idempotent matrix is 
uniquely determined by its range and null space (see, e.g., Sections 2.4 and 2.6]). 

Eigenprojections underlie the definition of the components of a matrix which, in turn, are 
used to define if {A) for differentiable functions if : C — > C (see either of [[141 Chapter 5], BT] 
Section 2.5], ifTTl . lfT6l ). in the theory of generalized inverse matrices, as well as in the numerous 
applications of matrix analysis. 

Let Ai, . . . , A s be all distinct eigenvalues of A; let v k be the index of \ k defined as the index 
of A — X k I. According to the theory of matrix components Ifl4l Chapter 5], for any function 
ip : C — > C having finite derivatives (p^'(Xk) of the first V}. — 1 orders at Ai, . . . , \ s , f(A) is 
defined as follows: 

s u k -l 

f{A):=Y,zZ^ ] ^ Z ^ ^ 

k=l j=0 

where the derivative ip^ of order is the value of if and Z k j are the components of A defined 
by 

Z k3 = (j\)-\A-X k iyz k0 . (6) 

'Such an eigenprojection is also called the principal idempotent |15|. 



January 16, 2013 



DRAFT 



JOURNAL OF KTpX CLASS FILES, VOL. XX, NO. X, 2013 



3 



Here, the component Z k0 is the eigenprojection of A — X^I (k = l,...,s) also called the 
eigenprojection of A at A&. 

For more details on eigenprojections, see, e.g., []3). 

B. The stochastic matrix of maximum out-forests 

A matrix A = (ay) of the model CD)-© determines a weighted communication digraph Y 
with vertex set V(r) = {1, . . . , n}: T has the (J, i) arc with weight Wji = whenever ay > 
(i.e., when agent j influences agent i). Thus, arcs of T are oriented in the direction of influence; 
the weight of an arc is the degree of influence. 

A diverging tree is a weakly connected (i.e., its corresponding undirected graph is connected) 
digraph in which one vertex, called the root, has indegree zero and the other vertices have 
indegree one. A diverging tree is said to diverge from its root. Spanning diverging trees are also 
called out-arborescences or out-branchings GUI . A diverging forest is a digraph all of whose 
weak components (i.e., maximal weakly connected subdigraphs) are diverging trees. The roots 
of these trees form the set of roots of the diverging forest. 

Definition 1. Any spanning diverging forest of a digraph V is called an out-forest of Y. An 
out-forest F of V is a maximum out-forest of T if T has no out-forest with a greater number of 
arcs than in F. The out-forest dimension of V is the number of components in any maximum 
out-forest of T. 

The weight of a weighted digraph is the product of its arc weights. The matrix J = (Jy) of 
maximum out-forests of a weighted digraph T is defined as follows: 

Jij = fy, hj = l,---,n, (7) 

where / is the total weight of all maximum out-forests of T and /y is the total weight of those of 
them that have i belonging to a tree diverging from j. In Proposition[Q we list some properties 
of L and J (cf. IfTOl , (S), 01) which are useful for the analysis of consensus protocols. 

Proposition 1. Let L be the Laplacian matrix of the model ([I])-©. Let J be the matrix of 
maximum out-forests of the corresponding communication digraph V whose out-forest dimension 
is d. Then: 

1) L is singular {since LI = 0); 

2) If A 7^ is an eigenvalue of L, then Re(A) > [2, Proposition 9]; 

3) indL = 1 [9, Proposition 12]; 

4) rankL = n — d\ rank J = tr J = d [1, Proposition 11]; 

5) J is row stochastic as by definition, YTj=i fij = f f or an y * e {1; • • • > n )j 

6) J 15 the eigenprojection of L [9, Proposition 12], which implies that J = J; 

7) LJ = JL = (H Theorem 5]; jV(J) = ft(L), ft(J) = Af(£) (ty item* El anJED; 

8) J= lim^ + aL)- 1 HI Theorem 6]; 
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9) J = C(0)/h(0), wherM C(X) is the quotient of the matrix polynomial Xh(X)I and the 
binomial XI — L, Xh(X) being the minimal polynomial of L (this follows from [14, Eq. (22) 
in Chapter 5]); 

10) J = J n ~d, where J n -d is defined recursively: J k = I — k ,, y" 1 , , k = l,...,n — d, 
Jq = J, and L J n -d = [2, Section 4] or BH Section 5]. 

An element wise characterization of J is given in [1, Theorem 2']. 

III. The forest consensus theorem 
Theorem 1. Let x(t) be a solution of ©. Then 

lim x(t) = Jx(Q), (8) 

t— >oo 

where J is the eigenprojection of L. Moreover, J coincides with the matrix J of maximum 
out-forests of the communication digraph corresponding to L. 

Proof. All solutions of © satisfy the identity 0H Eq. (46) in Chapter 5] 

x (t) = e- Lt x(0). (9) 
According to © e~ Lt is representable in the form (cf. Eq. (12) of Chapter 4 in lfT3l ) 

e- Lt = J2J2 Z U tje ~ Xkt > (10) 

k=l j=0 

where Ai, . . . , X s are all distinct eigenvalues of L. 

Since L is singular, we can set Ai =0. Then Z X j are the components of L corresponding to the 
characteristic root 0. By item[3]of PropositionCQ v\ = indL = 1 and by item[6]of Proposition[H 
Ziq, the eigenprojection of L denoted by J, coincides with the matrix J of maximum out-forests 
of the communication digraph T. 

Since the components Z k j of L are independent of t while, by item[2] of Proposition[D 
Re(A fc ) > (k > 2), we have 

s v k -l 

lim V V Z kj t j e~ Xkt = 0. (11) 

t->oo *■ — ' * — ' 
k=2 j=0 

Finally, ©-(HB and v\ = 1 yield 

lim x(t) = lim e" L *x(0) = Z w x(0) = Jx{0). □ 

t— >oo t— >oo 

2 In some cases, the expression J3] Theorem 1] can be more convenient for calculations. 
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IV. The properties of the asymptotic state 

Now we need some additional notation. A basic bicomponent of a digraph Y is any maximal 
(by inclusion) strongly connected weighted subdigraph of Y such that there are no arcs coming 
into it from outside. By [1, Proposition 6], the number of basic bicomponents in Y is equal to 
the out-forest dimension d of Y. 

Let x(oo) be the limiting state vector of the model dU)-©: x(oo) = lim^ 00 x(t). 

Corollary 1 (of Theorem [T). Let K be a basic bicomponents of Y; let j be a vertex of K. It 
holds that: 

1) If i is a vertex of K or i is reachable {by a directed path) from K and not reachable from 
the other basic bicomponents of Y, then Xj(oo) = Xj(oo) and Xj(oo) is equal to the value 
of consensus for the communication digraph K alone ; 

2) If vertex i is reachable from several basic bicomponents of Y, then Xj(oo) is between the 
minimum and maximum elements of x(oo) that correspond to these basic bicomponents 
(and is strictly between them if the minimum and maximum differ) ; 

3) If vertex i is not in a basic bicomponent of Y, then x(oo) is independent of Xi(0). 

Corollary [TJ is easily proved using the row stochasticity of J and two simple facts which follow 
from [1, Theorem 2']. The facts are: (1) ^ if and only if j belongs to a basic bicomponent 
of T and i is reachable from j; (2) If i and j belong to the same basic bicomponents in Y, then 
the z-row and j-row of J are equal, while the z-column and j-column are proportional. 

Using time shift and item [7] of Proposition Q] we have0 

Corollary 2 (of TheoremQ]). Let x(t) be a solution of ©. Then for any t Gl, J x(t) = x(oo). 
Consequently, for any ti,t 2 G R, J(x(ti) — a? (£2)) = 0, i.e., (x(ti) — xfa)) £ N{J) = 1Z(L). 

V. Example 

Consider the weighted communication digraph Y shown in Fig.Q] It has two basic bicompo- 
nents whose vertex sets are {1,2} and {3,4,5}. 




3 Cf. (6), equation between (16) and (17). 
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The Laplacian matrix © of the model CD-© corresponding] to T is: 



/ 2 
-1 





V o 



-2 



-4 



\ 









5 






-1 

-2 
2 


0-15/ 



The spectrum of L is real: (0, 0, 2, 3, 5, 5, 5), which is not generally the case for a Laplacian 
matrix of a weighted digraph. On the other hand, L is not diagonalizable as the geometric 
multiplicity of the triple eigenvalue 5 is 1. The minimal polynomial of L is 

Xh(X) = A(A-2)(A-3)(A-5) 3 . 

To find Z 10 = J, one can use item|9] of Proposition!]] 

C(0) 



no 



Mo) 



(12) 



where h{0) = (-2)(-3)(-5) 3 = -750, while C(0) can be determined using (55) and (56) in 
02 Chapter 4]: *(0,/i) = (// - 2)(// - 3)(/i - 5) 3 and 

C(0) = (0 ■ I, L) = (L — 2I)(L - 3I)(L - 5/) 3 . 



(13) 



Substituting C(0) and /i(0) into (O yields 



10 



J = J 



1 

750 



/ 250 


500 














0\ 


250 


500 























300 


150 


300 














300 


150 


300 














300 


150 


300 








150 


300 


120 


60 


120 








\ 30 


60 


264 


132 


264 








(14) 



The matrix J can also be found using item[T0l of PropositionQ] as well as (TT3T) . this involves 
four matrix multiplications, but it does not require the knowledge of the nonzero eigenvalues 
or the minimal polynomial of L. Direct enumeration of forests has no practical value for the 
computation of J . However, to give the reader a little taste of this "forestry", in Fig. 2 we present 
all 32 maximum out-forests of T and their weights. The total weight of them is / = 750; by the 
definition ©, it is the common denominator of the entries of J = (J^). The numerator of Jij 
is the total weight fij of the maximum out-forests in which i belongs to a tree diverging from j. 
For example, for J 65 , these are the forests #10, 12, 14, 16, 26, 28, 30, and 32 whose weights 
are 16, 4, 16, 4, 32, 8, 32, and 8, respectively, so that / 65 = 120 and J 65 = in concordance 
with (fl4l). 



On this correspondence, see Section III-B 
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Forest #1; weight = 12 




© © 
Forest #2; weight = 32 



Forest #5; weight =6 




© © 
Forest #6; weight = 16 



(^© 

Forest #9; weight = 6 




© © 
Forest #10; weight =16 



a>^©) g>^© 



Forest #13; weight =6 




© © 
Forest #14; weight = 16 



©—© (3 



Forest #17; weight =24 




© © 
Forest #18; weight =64 



GH~® 
Forest #21; weight =12 




© © 
Forest #22; weight = 32 



©©J^D ©K-© G 



Forest #25; weight =12 




(i>^© (|>^(4>^© ©^ C^T^T) 



© © 
Forest #3; weight =48 



Forest #4; weight = 8 



© © 

Forest #7; weight = 24 



© © 

Forest #11; weight = 24 




Forest #8; weight =4 

©^*© © 




-© 

Forest #12; weight =4 



5 Gy^-® ®e-® j© o-^® (3 



© © 

Forest #15; weight =24 




*© 

Forest #16; weight =4 



D ®*^© (3>^(©^© Ghr© (1 



© © 
Forest #19; weight =96 



© © 

Forest #23; weight =48 




Forest #20; weight = 16 

©~T^D © 




-© 

Forest #24; weight = 8 



D ©^ ®^®T^® ®~T^ £ 



© © 
Forest #27; weight =48 




*© 

Forest #28; weight = 8 



Forest #26; weight = 32 

©— © © -O .,© ©*t — © ©t 1 -® j© GM?) ©t^^j© Sh-® ©t^^j© 



Forest #29; weight = 12 




© © 
Forest #30; weight = 32 



© © 
Forest #31; weight =48 




Forest #32; weight =8 



Figure 2. The maximum out-forests of the communication digraph in the Example. 



January 16, 2013 



DRAFT 



JOURNAL OF KTpX CLASS FILES, VOL. XX, NO. X, 2013 



Using [1, Proposition 9] the set of all maximum out-forests of T can be described as follows. 
1. Choose an arbitrary spanning diverging tree in each basic bicomponent of T. 2. Choose any 
maximum out-forest in the digraph obtained from T by removing all arcs belonging to the 
basic bicomponents. Combining the chosen trees and forest gives a maximum out-forest of T; 
every desirable forest can be obtained in this way. A more detailed algorithm for constructing 
maximum out-forests can be found in 0] Section 5]. 

Let a;(0) = (1, 10, 5, 7, 9, *, *) T (the last two components are "free": they correspond to 
"nonbasic" vertices which, by Corollary [TJ do not affect the limiting state vector). By Theorem [TJ 

lim x(t) = Jx(0) = (7, 7, 7, 7, 7, 7, 7) T , 

t— >oo 

i.e., asymptotic consensus is achieved. On the other hand, if x(0) = (0, 6, 3, 9, 10, *, *) T , then 

lim x(t) = Jx(0) = (4, 4, 7, 7, 7, 5.2, 6.64) T , 

t— >oo 

and asymptotic consensus is achieved only within the basic bicomponents having vertex sets 
{1,2} and {3, 4, 5}, but not for the whole set of agents. 

Thus, a system satisfying ®-@ has its domain of convergence to consensus, that is, the set 
of initial states x(0) such that the product Jx(0) gives a vector with all equal components. In 
01, this domain (obviously, it is a subspace of R n ) is characterized and it is shown that when 
x(0) does not belong to the domain, then there is still some reasonable "quasi-consensus". It can 
by obtained by first, projecting x(0) onto the domain of convergence and second, applying the 
coordination protocol Say, for the initial states of the form x(0) = (0, 6, 3, 9, 10, *, *) T 

which were considered above, the value of such a "quasi-consensus" is 5.82. 

VI. On communication digraphs of out-forest dimension 1 

Suppose that the communication digraph T has a spanning diverging tree or, equivalently, the 
out-forest dimension of T is one (d = 1). In this (and only this) case, by item|4]of Proposition[T] 
rank J = 1 holds, so by item [5], 

J=lvf, (15) 

where vf is any row of J and vfl = 1. By items [7] and [H vf and 1 span the left and right null 
spaces of L, respectively. Thus, Theorem \T\ yields the following familiar necessary and sufficient 
condition of achieving consensus. 

Corollary 3 (of Theorem [T]). If the communication digraph V of the model (OQ)-© has a spanning 
diverging tree, then for any initial state x(0), x(t) converges to the consensus 

lim x(t) = (vfx(0)) 1, (16) 

t— >oo 

where vi is the unique left eigenvector of L associated with and satisfying vfl = 1. Conversely, 
if for each initial state x(0), x(t) tends to a consensus, then F has a spanning diverging tree. 

For the more restricted case of a strongly connected digraph T, a representation similar to ([TBI 
was obtained in ll22l Theorem 3]. In this case, it was shown that lim^oo e~ Lt = v r vj , where 
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vi and v r are, respectively, the left and right eigenvectors of L associated with and satisfying 
vfv r = 1. Before Theorem 1, the authors of 11221 mention that 1 can be substituted for v r . 

Corollary |3] coincides with [1201 Theorem 3.12] (see also fl20l Proposition 3.1 1] and Lemma 1.3 
in 11231 ). The case of a communication digraph T having a spanning diverging tree was recently 
considered in []6l where Lemma 3 presents an analog of ([Tot . However, the multiplier 1/ 'y/n in 
(61 Eq. (18)] is not correct due to an invalid step in the proof. 

Finally, observe that Theorem III. 8 in 11261 can also be derived from Theorem [T] 

VII. A DISCRETE COUNTERPART OF THE FOREST CONSENSUS THEOREM 
Consider the discretization of the model ©: 

x(t + t) - x(t) 

— - — = -Lx(t) (17) 

T 

with a small fixed rGK. Let y{k) := x(kr), k — 0, 1, . . . , be the state vector with the discrete- 
time dynamics determined by (flTl ). Then 

y(k) = (I-rL)y(k-l), k = l,2,.... (18) 

Setting 

P =1 -tL (19) 
and observing [Q3 Section 8] that P is row stochastic whenever 

< t < (max ^ a ij) 1 ( 2 °) 

we obtain DeGroot's iterative pooling model [fT2|: 

y(k) = Py(k-l), k = l,2,.... (21) 

Matrix (fT9l is sometimes called the Perron matrix with parameter r of the weighted digraph T. 
Obviously, P is the linear part of the series expansion of e~ ri . 

Let us compare the asymptotic properties of the model © and its discrete analog (12Tb . From 
(12TT) one has 

y(k) = P k y(0), k = 0,1, (22) 

A necessary and sufficient condition of the convergence of {P k } under (i20T > is the aperiodicity 
of P. On the other hand, the Cesaro (time-average) limit 

1 k 

P°° := lim - VP' (23) 
fc-+oo k ^ — 4 

i=l 

exists for any stochastic P and coincides with lim^oo P k whenever the latter exists. Otherwise, 
if P is periodic with period s, then P°° = s' 1 (P (1) + . . . + P (s) ) , where P (1) , . . . , P (s) are the 
limits of the converging subsequences of {P k }: PW = li m pi s + 1 ^ % = 1 ; . . . ; s . 

The discrete-time counterpart of Theorem [T] is an immediate consequence of well-known 
results. Yet, for ease of comparison with Theorem [TJ we represent it in the form of a theorem. 
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Theorem 2. Let sequence y(k) satisfy (|2TT) . where P is defined by (fT9~l)-([20l). Then 

1 fc 

i=l 

where J is the eigenprojection of L, which coincides with the matrix J of maximum out-forests 
of the communication digraph T corresponding to L. Moreover, if (l20l) is satisfied strictly, then 

lim y(k) = Jy(0). (24) 

k— ¥oo 

Proof. Meyer ||2TI and Rothblum [24] have shown that P°° is the eigenprojection of I — P. 
Hence, by (TT91 ) and the definition of eigenprojection, P°° = J . Now applying the Cesaro limit 
to (|22|) and using (|23l) and item |6] of Proposition \T\ one obtains the first assertion of Theorem |2] 

Alternatively, the identity P°° = J coincides with the Markov chain tree theorem first proved 
by Wentzell and Freidlin 11271 and rediscovered in [fl9l , lfl8l . This identity provides the first 
assertion of Theorem |2] along the same lines. 

Finally, if (|20l) is satisfied strictly, then P has a strictly positive diagonal. In this case, by 
Gersgorin's theorem, P has no eigenvalues of modulus 1 except for 1. Hence, P is not periodic 
and {P k } converges, which yields (l24l . □ 

Obviously, the only essential difference between Theorem |2] and Theorem \T\ is the use of the 
Cesaro limit in the case of a periodic matrix P. With a similar "Cesaro" addendum one can 
easily formulate a discrete-time counterpart of the Corollary [3] of Section [VTl 

To compute the matrix J = J, one can use items l8l4TOl of Proposition [T] constructive 
characterizations (h), (j) or (1) in []3] Section 2], or [flT] Proposition 2]. 
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